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sequential  tests  applicable  to  testing  bombing  system 
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I .   OBJECTIVE 

In  this  thesis  the  Sequential  Rayleigh  Test  and  three 
sequential  binomial  tests,  which  are  applicable  to  testing 
bombing  system  accuracy,  are  compared  by  computer  simulation, 

The  objective  of  this  thesis  is  to  investigate  expected 
sample  size,  variance  of  sample  size,  error  rates  of  these 
tests,  and  to  investigate  their  robustness. 


II.   DESCRIPTION  OF  THE  TESTS 

A.   INTRODUCTION 

There  are  two  types  of  tests  of  a  system  (which  is 
taken  to  be  a  bombing  system  in  what  follows) .   The  sample 
size  is  determined  as  a  direct  result  of  the  experiment 
in  one  case  (and  is  therefore  random) ,  and  the  sample  size 
is  selected  prior  to  commencing  the  test  in  the  other  case. 

The  former  procedure  is  called  a  sequential  test    [1] . 
The  test  procedures  being  considered  here  are  sequential, 
and  are  based  on  assumed  circular  normal  distribution  (that 
'is,  bivariate  normal)  with  the  same  variance  in  each  co- 
ordinate.  In  the  coordinate  system  of  the  target  plane  it  is 
ass\imed  that: 

X-—  Normal  ( 0, a^) 
Y^-  Normal  (  0,a^)  . 

The  origin  of  coordinate  system  is  the  target,  and  x  and 
Y  are  distances  from  the  weapon  impact  to  the  target  along 
the  X  and  Y  axes . 

If  it  is  further  assumed  that  X  and  Y  are  independent, 

then  — ^   is  normal  with  mean  0,  variance  1.   — ^  is  normal 

o  o- 

with  mean  0  variance  1.   Thus   (  -^)      +      (  —^)      has  Chi- 

o  o 

square  distribution  with  two  degrees  of  freedom. 


The  density  function  of  Chi-square  with  two  degrees  of 
freedom  is  [2] . 


f^  (t)    =     -^ .  e  "^/2,  t>o 


'T 


2.r(i) 


1    -t/2 
7  ^ 


This  is  the  exponential  density  function  with  parameter 
X=  ^  .    Here, 


X  ^    Y^  _  X^  +  Y^   ,  where  X^  +  Y^  is  squared  miss 

2  "^   2  "^      2 

a    a        a 

distance  of  the  impact  from  the  target.   Let  this  be  another 
random  variable  Z.   Then, 

Z  ^  Exp(L 
The  density  function  of  Z  is  derived  as  follows: 


F2(z)  =  P  [  Z<  z  ] 


a     a 


Let  5"  be  Z  ; 


then  F^Cz)  =  F2-  (  -^) 

a 


Where  Z'  is  exponentially  distributed  with  parameter  x=  -y- 


Then 


F^-C^)  =  l-exp[-2/2.a^]=F2(z)  . 

From  the  relation  that  — 2—  =  Z ''  the  density  function 

a 

of  Z  is  [5] 

— K-   exp[-z/2.a^  ]   =  f„(z) 
2a^  ^ 

which  is  the  exponential  density  function  with  parameter   A=  1 


2a^ 


2 

Assume  C  is  the  median  of  Z  (C  represents  CEP   which  is  de- 
fined to  be  the  median  of  the  squared  Circular  Error  Probable 
[6]). 

Then  by  definition: 
F^CC)  =  \ 

1  -exp[-C  /2.a2]=  1 
^2  =   ln{\) 


2a 


2      _        C 


!?n2 
Thus  Z  ^  Exp  (^^) 


If  a  bombing  system  has  been  specified  to  have  median  radial 

miss  distance  Yq  and  if  a  system  with  radial  miss  distance 

2 
Yi  is  unacceptable,  this  can  be  tested  with  Co=  Yo   as  the 

2 

null  hypothesized  median  and  Ci  =Yi  as  the  alternative 

hypothesized  median.   Here,   £n2     £n2   are  the  parameters 

Co   '   C;L 
under  null  and  alternative  exponential  distributions, 

respectively . 

In  what  follows  C©  will  be  treated  as  median  under  null 

hypothesis  and  C-,  as  median  under  alternative,  where  these 

quantities  relate  to  the  squared  radial  miss  distribution. 

B.   TEST  CASE  A:   SEQUENTIAL  RAYLEIGH  TEST 

If  a  system  is  to  be  tested  with  null  hypothesis 

H^:  CEP  ^  =  C^  and  alternative  hypothesis  H, :  CEP  ^  =  C, 
o  o  -"^         11 

with  type  I  and  type  II  error  rate  a  and  g,  then  a  sequential 

test  for  H   against  H,  can  be  defined  as  follows.   We  shall 
o   ^       i 

call  this  the  "Sequential  Rayleigh  Test"  in  what  follows; 

it  is  an  application  of  Wald ' s  Sequential  probability  ratio 

test  to  the  exponential  situation  described  above. 

Two  positive  constants  are  chosen,  B  and  A,  where  B  <  A. 

At  each  stape  (n-th  experiment  or  observation) ,  the  probability 

ratio    n       ^^^i''  ^1^ ,  called  the  likelihood 

i=l      f(^i'-  Co) 

ratio  [3],  is  computed,  where   f(Zj_;  C-)  is  the  exponential 

density  function  with  parameter   £  n2  ,      j  =  1^2 

C. 


10 


n   f(Zj^,  Cj^) 
If  B<  .n,  -s-j p;— r-  <A,  then  another  observation  is  made  (this 

st 
means  the  test  enters  the  (n+1)    stage) . 

If  the  likelihood  ratio  does  not  fall  in  the  interval  (B/A) , 

called  the  continuation  region,  the  test  terminates. 

In  termination,  the  conclusion  is  to: 


n 


f(Zj^,  C^) 


Accept  H^  if  -Bj^   f(z.^  c  )   -  ^' 


n 
Reject  H_  if   IT    j  ;_~ — „^ ^       >   A. 


i=l    •  1'   o' 
For  a  test  with  approximate  level  of  significance  a  and  power 

1-3,  one  may  define  [1] 

3 


A  =  -^^  '  and  B  = 


a 

Thus,  an  approximate  bound  for  each  stage  can  be  obtained  as 
follows: 

The  explicit  form  of  the  likelihood  ratio  is 

n   f(z^,Cj^) 
i=l  i*^i'Co> 

(Jln2/C-j^)  .exp[-z^.£n2/C-j^]  .  -  -  -  .  (£n2/C.j^)  .exp  [-z^.£n2/C-]^] 
(£n2/C^)  .exp[-z^.£n2/C  ].  -  -  -  .  (£n2/C  ).exp[-z  .iln2/C  ] 

(£n2/CT)^.  (P   z.).exp[-£n2/CT] 
=  ^     i=l   ^ ^ 

(£n2/C  )^.(   z  z.) .exp[-£n2/C  ] 
°     i=l  ^  o 


11 


=  ^o 


n 


-n 


2.1  \%n2   -  £n? 
i=l    7  '  CT~   C 


1  /   e   ^^^    /  L"l    "'o 
This  is  equated  to  A  and  the  logarithm  is  taken  to  obtain 
rejection  bound  R  for  the  n-th  stage; 


n 


n 


E   z.l  )£n2  -  iln2 
i=l 


The  test  rejects  H   if 


n 


where   E   z.  is  sum  of  squared  radial  miss  distances. 
i=l 

The  same  procedure  can  be  applied  to  B: 


£n 


Z   z.'\/£n2    -   £n2 

i=i   r\  -cT"       —. 


The  test  accepts  H   if 


n 

E 

i=l 


-jj,n/-rAr\  +   n»£n 


Zi  < 


{-) 


/=o 


(«,n2)  .  /  1   -   1 


=  \ 


Here,    it  is  assumed  C-,  >  C  ,  which  is,  we  envision,  true 
in  the  bombing  system  test. 
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C.   CASE  B:   SEQUENTIAL  BINOMIAL  TEST  WITH  Pq  =  7 

In  the  study  of  bombing  system  the  target  is  defined  to 
be  a  point  on  the  impact  plane  and  impact  of  a  bomb  within 
(over)  some  distance  /r     from  the  target  is  defined  to  be  a 

hit  (miss) . 

2 
A  null  hypothesis  that  CEP   =  C   is  to  be  tested  against 

2 
an  alternative  hypothesis  that  CEP   =  C-,  ,  with  Type  I  and 

Type  II  error  rates  a  and  6,  where  C   <  Ct . 

2 
Also  this  system  can  be  tested  with  CEP   <  C  as   null 

2 
hypothesis  and  CEP   ^  C-,  as  alternative  hypothesis  without  al- 
tering the  test  procedure. 

Let  P   be  defined  as  the  probability  of  hit  under  the  null 

hypothesis,  and  P,  to  be  the  hit  probability  under  the  alterna- 

2 
tive  hypothesis.   Then  under  H  ,  CEP   <  C  ,  which  says  the 

true  median  of  squared  radial  miss  dis  tance  is  less  than  or 

equal  to  C  ,  implies  the  probability  of  hit  is  greater  than 

or  equal  to  0.5. 

Similarly,  CEP   >  c,  implies  the  probability  of  hit  is 

less  than  or  equal  to  0.5  under  the  alternative  hypothesis.   So 

the  new  hypotheses  are  defined  as  H  ;  P^>   0.5  and  H, :  P,  <  0.5 

00  1    1  ■" 

From  this  hit  or  miss  criterion  r,  a  value  of  squared  radial 
miss  distance  may  be  obtained  which  gives  P   value  of  0.5; 
i.e. ,  if 
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-£n2  .  r 
F^(r)  =  1-e  =  0.5 

then  £n(0.5)  =  {ln2) .     (-   ^^  )  ,   so  r  =  C^. 

o 

The  alternate  hit  probability  P,  is  found  as  follows: 

P,  =  P   [hit  I  CEP^  =  C,] 
1    r  ^     '  1 

I     2 
=  P   [observed  squared  radial  miss  distance  <  r  |  CEP  =C, ] 

£n2    ^ 
=  1  -  e  ~ 

£n2  ^o 

'  ^1     °        '  ^ 
=  l-e  =1-2 

Let  the  random  variable  Z.  be  defined  as: 

0  if  miss  (squared  miss  distance  >  r) 
z  .  = 

'1  if  hit  (squared  miss  distance   <  r) 

Then  the  likelihood  ratio  becomes 

n    f  (z  ,P  ) 

i=?      f  ^^i'^O^ 


(P^)^  (1-pl)''"^ 

(1/2)^   (1/2)''"^ 
(    ^1  \  ^  .   (l-P.)''  .  2^ 


n 
Where  Z  =   E    z 
i=l 


1 
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For  a  sequential  probability  ratio  test  for  the  binomial 

situation,  the  experiment  is  continued  as  long  as  this  value 

remains  between  B  and  A. 

An  approximate  acceptance  boundary  is  found  by  substituting 

B   for  B  [1]  . 
1-a 

Then   Jin  |^^>     f    Z      z\  in    Crp-j  +  n  .  £n(2  (1-Pj_)  )  . 
Substituting    (l-2"^o/^l)    for   P^   gives 


^  2 

n 
Solving  for  .£,  z.,    which  is  a  convenient  test  statistic: 


n  ^^  /^6-\  -n.(  1  -  Cq/C-|^)  .  £n2 

E    z.  >  ~^      .   =  A„ 

•5—1  ^          c_/Ct                     n 

^-1  Hn    {2  °   1  -  1) 


Cq/Ci 


(The  inequality  changes  because  C  <C,  implies  2      -  1  <_  0.) 

Where   ^   z.  is  the  number  of  bombs  which  hit  the  target,  out 

^=^  1-6 

of  the  total  fire,  n.   And  substituting   — -   for  A,  an 

approximate  rejection  boundary  is  found  to  be: 
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£n 
n 


1-6) -n.  1-^0  V^n2 


v^  J         \      ^i 


Z    Z.  <  /  Cq/Ci   \        ^n 

i=l   ^  £n  2  ^  ^   -1 


The  test  now  operates  as  follows: 
in  stage  n. 

Accept  Hq  if   J.   ^i  -  ^n' 
i=l 

Reject  H^  if   „    z.<   R  ; 
-^      0     .Zt    i"   n' 
1=1 

Continue  to  stage  n+1  otherwise. 


D.   CASE  C:   A  SEQUENTIAL  BINOMIAL  TEST  WITH  NULL  PARAMETER 

WHICH  MINIMIZES  E [N]  UNDER  Hq. 

2 
This  case  also  has  null  hypothesis  CEP  <Cq  and  alter- 

2 
native  CEP  >C,.   Let  PqCt)  be  the  probability  of  hitting  a 

target  of  radius  \/t,    and  let  P-,  (r)  denote  that  probability 

under  H, .   In  mathematical  form: 

jLn2    .  r 

PQ(r)  =  PQ(Z<r|CEP^  =  Cq.)  =  1-e    ° 


£n2 
P;j^(r)  =  Pj^(Z<r|CEP^  =  C^)    =   1-e 


.2   _    ,     ^1 


16 


c  /c 

Thus:   P^(r)  =  1  -  [1  -  ^Qir)]    °   ■"■ 

It  is  desired  to  determine  r  so  as  to  minimize  expected  sample 
size  n,  required  to  test  Hq  vs  H,  with  Type  I,  II  error  rates 
a,B  respectively,  using  the  Binomial  Sequential  Probability 
Ratio  test. 

The  average  sample  size  function  is 
J,  ^^j  ^   (l-L(P)).£nA  +  L  (P).£nB        ,  [1],  [4] 


/Pn  (r)\  /1-P.  (r)' 


where  P  is  the  true  probability  of  hit  and  L(P)=P  [accept  Hq|P]. 

If  Pr)(i^)  is  chosen  to  be  the  underlying  hit  probability,  then 

L(PQ(r))=l-a. 

By  substituting  L (Pq (r) ) =l-a, 

A  =  1-1,  P3_(r)=l-(l-PQ(r))-CQ/C^,B  =   6 


a  1-a 

in  E [N]  function,  the  expression  above  becomes 


E(N)  ** 


lk±\  /  B  \ 

a£n  \   a  J+    (l-a)£n(,T^/ 


^o/^i\ 

1-(1-P  (r))  -I+Cq/Ct 

Po(r).[^n| VlTl -)]  +  (l-PQ(r))JLn[a-PQ(r))     ^  ^] 

If  a  value  of  PQ(r)  which  minimizes  E(N)  is  obtained,  r  is  also 
obtained  from  PQ(r).   The  numerator  is  a  negative  constant  as 
long  as  3<0.5  and  a<0.5  and  the  denominator  is  a  negative  variable 
depending  on  r. 
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Therefore,  in  order  to  minimize  E(N)  it  is  necessary  only  to 
maximize  the  absolute  value  of  the  denominator. 


Let    ^o 


^1 


Then  for  various  values  of  K,  PQ(r)  may  be  found. 
Figure  1 1"  Is  hows  a  plot  of  PQ(r)  vs  k  resulting  from  this 
minimization.   As  k  approaches  infinity  P-jCr)  approaches  1.0;  as 
k  decreases  to  zero  P-^Cr)  decreases  to  around  0.63.   Specifically, 
for  k  =  2 

P^ir)    =   0.8416,  P-j_(r)  =  0.6020. 
From  this   r  is  found  to  be 

Let  Z  be  a  random  variable  such  that 

0  if  squared  miss  distance  >  r 
i  if  squared  miss  distance  <   r 

where  r  =  2.6583  6. 

Then  the  hypotheses  in  this  Binomial  test  becomes: 

H^:  Pq  =  0.8416,  H-,_ :  P^^  =  0.602. 

If  Pq  =  0.8416,  P-j^  =  0.602  are  substituted  in  the  likelihood 
ratio  (similar  to  Case  B  above) ,  acceptance  and  rejection  bounds 
at  stage  n  are: 

Accept  H   if 

n 


Z.  = 

1 


ill  Z.  >  -1.2564  .  £n(_e  )  +  n. 0.7333  =  A„ 
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o  —I 


Q 


n 

2.[l 


70 


K    c'cij   ; 


<3.^3 


■i.'i: 


i':.23 


K 

0.001 

0.1 

0.3 

0.5 

0.90 

1.01 

1.414 

1.5 

^o 

0.632 

0.655 

0.707 

0.745 

0.789 

0.800 

0.820 

0.824 

K 

2.0 

3.0 

5.0 

7.0 

10.0 

20.0 

50.0 

100.0 

Pq 

0.842 

0.863 

0.886 

0.899 

0.910 

0.928 

0.944 

0.953 

FIGURE    II-l 
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Reject  H  if 


E     Z.  <  -  1.2564.;n  (  i^^)  +  n. 0.7333  =  R 


i=l 


a 


n 


Continue  otherwise. 

E.   CASE  D:   A  Sequential  Binomial  test  with  null  parameter 

which  minimizes  maximum  value  of  E(N) 

In  the  binomial  situation  described  above,  the  hypotheses 

about  the  parameter  are 

H^:  P  =  P 
o       o 

H^:  P  =  Pj_. 

The  maximum  average  value  of  E (N)  occurs  very  nearly  at 


in 


P-  = 


l-Pl(r) 


/  P,  (r)\      /  l-P,  (r) 


[4] 


from  which 


E(N)  =    "'^-  ^"S 


/P, (r)\      /1-P, (r) 


mA.    9j\B 


£n 


n.-(l-P^(r)fo/^l 


L 


P^(r) 


r: 


in 


{l-Po(r))' 


Cq/ci 


l-P^(r) 


(P;L(r) 


=  1  - 


[1-P^(r)f  q/^I,  See  Case  B) 


The  numerator  is  a  negative  constant  for  given  a  and  6 
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similarly  as  in  Case  C  by  maximizing  the  absolute  value 

of  the  denominator,  the  maximum  value  of  E [N]  is  minimized  (or 

at  least  nearly  so) . 

Figure n-^s hows  the  relation  between  P  (r)  and  k  =  -tt- 

°  ^o 

Specifically  for  k  =  2 

P^(r)    =   0.89867,    Pt  (r)    =    0.68167   with  r  =   -    £  n(l-o . 89867)      = 
°  ^  W2 

3.30286  is  obtained. 

Hence  the  hypotheses  for  this  case  are  H  :  P=0. 8  98  67, 
H^ :  P=0. 68167,  and  "hit"  is  defined  by  squared  radial  miss 
distance  less  than  or  equal  to  3.3  028  6. 

Let  Z  be  a  random  variable  such  that 

(^   if  squared  miss  distance  >  3.30286 
z.  = 

/I  if  squared  miss  distance  <  3.30286. 

Proceeding  similarly  as  in  Case  B,  the  decision  at  stage  n  is 


Reject  H   if 
•^     o 


Z    Zj_  <  -1.42167  .  ilnn-B)  +  n.  0.80552  =  R^ 


n 

E 
i=l 


Accept  H   if 


n 
Z 
i=l   "^  ^  T^ 

Continue  to  state  n+1  otherwise. 


Z    Zj_  >  -1.42167  .    Zn    {      6  \  +  n.  0.80552  =  A^^ 
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iO  00 


ad& 


K 

0.05 

0.1 

0.3 

0.5 

0.7 

0.9 

1.01 

1.414 

^O 

0.5 

0.504 

0.602 

0.681 

0.738 

0.780 

0.794 

0.851 

K 

1.5 

2.0 

2.5 

3.0 

4.0 

5.0 

7.0 

10.0 

^O 

0.859 

0.899 

0.925 

0.944 

0.968 

0.982 

0.994 

0.999 

FIGURE    II-2 
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III.   DETERMINATION  OF  SIMULATION  FACTORS 

For  convenience  the  hypotheses 

Hq:   CEP^  =  1 

2 
H,:   CEP   =  2   were  selected. 

This  means  k  =  2  in  Case  C  and  D. 

Type  I  and  Type  II  error  rates  were  selected  to  be  0.05. 
But  actual  simulation  gives  Type  I  error  rates  .0258,  .0468, 
.0396,  .0292  and  Type  II  error  rates  .0396,  .0402,  .0420, 
.0400  for  Case  A,  B,  C,  and  D,  respectively.   This  point  is  ex- 
plained in  Chapter  3.3  of  [1].   Approximate  error  rates  of 

0.05,  0.05  (Type  I,  II)  were  obtained  by  adjusting  the  bounds 

1—  6 
A  and  B,  which  is  possible  by  changing  a,  6  in  A  =  — — ^  ,  B  = 

y—-  .   The  adjustment  factors  used  here  are: 

CASE  A  a=  2. Ox  0.05    6  =1.2x0.05 

CASE  Ba=1.2x0.05    3  =1.2x0.05 

CASE  C  a  =  1.5  x  0.05    6  =  1.15  x  0.05 

CASE  Da=1.5x0.05    6  =1.1   x0.05 

How  many  replications  are  enough?   Assuming  N. ,  N^  have  Bi- 
nomial distribution  with  probability  of  success  0.05,  a  sample 


^  ^ 


size  n  is  found  such  that  P  (  P, -P^  <c)  =  1- a  ,  where  a  is  the 

r  '  1   2  '  ' 

significance  level,  P-,  i=l, 2  is  the  estimation  of  P^  .  The  above 
equation  implies 

Pj.(-c  <  ?!  -  ^2  ^  ^^  =  1-a 

P^(-c  <  ^  -  ^  <  c)  =  1-a 

n    n 
P  (-nc<  N  -  N  <nc)  =  1- a 
r        12 
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By  the  Normal  approximation  ,  (N,  -  N2)'^  Normal  with  mean  o  and 

Variance  2np(l-p). 


Thus 


Pr   t  - 


nc 


x^/2np(l-p) 


<   -—1=="  "^ 
V''2np(l-p) 


nc 


Y'2np(l-pr, 


]  =  1-a 


gives 


nc 


s^np(l-p) 


=  Zt   a 


The  following  table  shows  n  for  various  values  of  a  and  c 


VsCt 

0.2 

0.1 

0.05 

0.025 

0.02 

c        \ 

1.285 

1.645 

1.96 

2.24 

2.33 

0.2 

3.9 

6.4 

9.1 

11.9 

12.8 

0.1 

15.7 

25.7 

36.1 

47.6 

51.5 

0.05 

62.7 

102.8 

145.9 

190.7 

206.3 

0.025 

250.9 

411.3 

583.9 

762.7 

825.2 

0.01 

1568.7 

2570.7 

3649.5 

4766.7 

5157.5 

0.001 

156866.4 

257072.3 

361237.5 

476672.0 

515745.5 
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Assuming  c  =  0.01  and  a=  0.02,  an  approximate  value  of 
5000  is  obtained  through  the  table.   By  this  number  of  re- 
plications, obtaining  a  difference  in  estimated  error  rates 
greater  than  0.01  is  significant  at  level  0.02.   Exponential 
random  samples  were  generated  by  the  Monte  Carlo  method.   For 
an  exponential  variate  T  to  have  median  m,  it  is  necessary 

to  use  the  scale  parameter  x    =   £  n  2 

ln2   ^  ^ 


so   F^(t)  =  1-e 

But  U  =  F'T.(T)  is  uniformly  distributed  on  (0,1)  [8]. 

-T 
Thus   2  ITT"  =  1  _  F(T)=1-U     is  also  uniformly  distributed. 

Finally  t  .  £n2  =  -In  U ,    or 
m 

T  =  -  m.   il  n  U   . 
TnT" 

By  changing  the  median  of  the  population  sampled,  the 
operating  characteristic  function,  expected  sample  size  at 
termination,  and  its  variance  can  be  estimated  for  each  test, 
and  those  can  be  compared. 

The  medians  to  be  generated  are  those  which  result  in  a 
0.1  difference  of  operating  characteristic  function  values 
in  Case  C,  which  is  based  on  minimizing  the  maximum  E(N), 
those  which  yield  Type  I,  II  error  rates,  three  points  which 
yield  approximate  maximum  E(N)  value  (for  Cases  B,  C,  D) ,  and 
five  more  points  in  both  tails. 
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By  changing  the  skewness  of  the  sample  distribution, 
comparison  of  the  robustness  of  the  four  tests  of  hypotheses 
about  the  medians  under  null  and  alternative  hypothesis  was 
performed. 

This  is  based  on  the  assumption  that  the  underlying 
distribution  is  WEIBULL  with  shape  parameter  a  and  scale 
parameter  X . 

If  T  -^  WEIBULL{a,  X  }, 

the  distribution  function  of  T  is 

-  (XT  )  o' 
F^(T)  =  1  -  e'  ^ 

Let  m  be  the  median.      Then 
P^  [T    >   m]    =   Pj^[T    <   m]  ; 

1  -  e-^'^>'=  0.5, 
£n(o.5)  =  -  (X.m)°^  . 
Solving  for  X , 

m  ■■ 

Now  1-e  -^^'^^    ^   U(o,l),  so 

£n(l-U)  =  -  (XT)"  , 

T  =  y  [£n(U)  ]^  ,  where  U -^  U  (o,l). 

Substituting  X  =  i  (]Jn2)^/°' 

m 

1  11/ 

T  =  m  .  ,01  y. "^WEIBULL {a  ,^   (£n2  )^/°'}. 
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Following  histograms  in  Figure  III-l  show  the  effect  of 
changing  a  in  WEIBULL.   As  a  decreases  the  distribution  is 
widely  spread  and  it  is  said  that  the  distribution  has  heavy 
tail  (Figure  III-l,  ^).   In  the  opposite  case;  i.e.  a  increases, 
it  has  light  tail  (Figure  III-l,  A) . 

Figure  III-2  is  observed  keeping  a  fixed  at  1  and  median  is 
0.5,  1.0,  2.0  in  WEIBULL. 

This  is  exponential  distribution  with  median  0.5,  1.0,  2.0. 
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IV.   RESULTS  AND  COMMENTS 

Simulation  of  the  four  tests  were  performed  5,000  times 

2 
(5,000  replications).   In  each  replication  H  :  CEP  =1; 

2 

H-,  :  CEP   =2;  and  Type  I,  II  error  rates  are  0.05. 

The  following  tables  rV-1,2,3  show  the  mean  number  of 
terminations,  their  variances,  and  number  of  acceptances  of 
H   in  5,000  replications. 

Table  IV-ls hows  the  effects  of  changing  median  values,  where 
the  shape  parameter  of  the  WEIBULL  variate  was  fixed  at  1.0 
(the  exponential  variate  with  changing  median) .   Table  IV-2  and  3 
shows  the  effects  of  changing  shape  parameter,  the  median  being 
fixed  at  1.0  in  table  IV- Zand  at  2.0  in  table  IV-3. 

For  ease  of  comparison  these  were  graphed.   Each  figure 
contains  four  curves  and  each  curve  represents  the  case  A,  B, 
C  or  D. 

In  testing  the  difference  of  E [N] ,  null  hypothesis  would  be 
E[N-j^]  =  E[N2]/  where  N,,  N2  are  random  variables  representing 
the  number  of  termination  by  test  cases  which  one  wishes  to 
test  the  difference  of  the  E [N] . 

By  the  central  limit  theorem  [2]  the  difference  in  E [N] 

greater  than    1. 96  x^  is  significant  at  level  0.05.  d    is 

n 
estimated  standard  deviation  of  N.   But  it  is  different 

between  the  test  cases  being  considered. 

The  larger  one  might  be  selected  so  that  we  may  not 

reject  H   erroneously. 
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REFERENCE  FOR  THE  FIGURES  IV-1  -  IV- 9 


CASE   A 

+  — 

+  — 

+ 

CASE   B 

• 

* 

* 

CASE   C 

X    

X    

X 

CASE    D 

FIGURE  IV-1,  4,  7 
FIGURE  IV-2,  5,  8 
FIGURE  IV-3,  6,    9 


Expected  Sample  Sizes 
Variances  of  the  Sample  Sizes 
Operating  Characteristic  Curves 
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The  interpretation  of  the  figures  is  as  follows: 

a.  Variances  or  standard  deviations  are  approximately  pro- 
portional to  expected  sample  sizes. 

b.  Test  Case  A  contains  the  minimum  expected  sample  size  and 
Test  Case  B  includes  the  maximum  expected  sample  size  in 
almost  all  instances. 

c.  Case  C  and  Case  D  yield  similar  results  when  median  is 
changing  and  shape  parameter  is  fixed  at  1.0. 

d.  Test  Case  B  is  invariant  about  the  change  of  skewness 
when  the  underlying  median  is  1.0  (See  Figures  IV-4,5,6). 

e.  Case  B  also  gives  the  lowest  error  rates  if  the  bomb  im- 
pact has  a  heavy  tail  distribution  under  the  alternative 
hypothesized  median,  and  has  light  tail  distribution  under 
null  hypothesized  median  (Figure  IV-6.9). 

f.  Case  C  gives  the  lowest  error  rate  when  the  true  median  is 
2.0  and  bomb  impacts  are  clustered  around  the  median. 

NOTES : 

a.  The  adjusting  factors  of  the  error  rates  table  were  devel- 
oped iteratively  and  there  is  no  guarantee  that  these  ad- 
justing factors  are  the  best  ones. 

b.  There  could  be  further  investigation  of  effects  under  er- 
ror rates  other  than  0.05,  or  of  changing  null  and  alterna- 
tive hypothesized  median  values. 

c.  The  Fortran  program  for  this  simulation  is  attached  as  an 
Appendix. 
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V.   CONCLUSION 

If  it  is  certain  that  the  bomb  impact  is  Rayleigh  distributed, 
then  Sequential  Rayleigh  Test  is  appropriate  to  test  the  system. 

In  case  one  has  doubt  about  the  bomb  impact  distribution, 
the  Sequential  Binomial  Test  gives  better  tests  than  the  Se- 
quential Rayleigh  Test. 

Further,  if  there  is  some  reason  to  believe  that  the 
median  is  likely  to  be  1  (so  the  test  is  likely  to  accept  H  ) , 
Case  B  (Null  parameter  P  =0.5)  is  better  than  any  of  the  other 
three  tests. 

If  the  median  is  not  likely  to  be  1,  test  case  A  (Sequential 
Rayleigh  Test)  or  test  case  C  (which  has  null  parameter  that 
minimized  E [N]  under  H  )  are  the  best  tests. 
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APPENDIX 

DIMENSION  BGUND(300,2t4),DATA(4T4) , T EST  (  500  0, 2,  4) 

C       BOUND CONTAINS  DECISION  BOUNDARIES  FOR  EACH  STAGES 

C      TEST FIRST  ELENENT  REPRESENTS  NUMBER  OF  REPLICATION 

C  SECOND  ELEMENT  REPRESENTS  DECISION 

C  THIRD  ELEMENT  REPRESENTS  TEST  CASE(A»B,C  OR  D) 

C      DATA TEST  RESULT, FIRST  ROW MEAN  NUMBER  OF  TERMINA 

C         TION  SECOND  ROW VARI ANCEt THIRD  ROW NUMBER  ACCEP 

C        TANCE  FOURTH  ROW NUMBER  REJECTION 

ISEED=  688777 
NC0UNT=50C0 
READ(5,2) ALPHA, BETA, CO T CI 

C      CO MEDIAN  UNDER  THE  NULL  HYPOTHESIS 

C      CI MEDIAN  UNDER  THE  ALTERNATIVE  HYPOTHESIS 

WRITE(6,140)ALPHA,BETA,C0,C1 
140   F0RMAT(5X, •ALPHA=» ,F6.3,'    3E TA= • , F6. 3 , •    C0=',F6.3 
*,•    C1=«,F6.3) 

R=-C0=*AL0G(.1584)/(  AL0G(2.  )  ) 

C      R HIT  MISS  CRITERION  IN  CASE  C 

C      R2 HIT  MISS  CRITERION  IN  CASE  C 

P40=. 898657 

R2=(AL0G(1-P4D) )/ALGG(.5) 
P41  =  I.-I./2*=*(R2/2.  ) 
2    FaRMAT{4F6.3) 
C    COMPUTE    BOUND    OF    REJECTION    AND    ACCEPTANCE 
B1=AL0G(  1.2=^BETA/(I-2.*ALPHA)  ) 
A1=AL0G{ ( 1-1.2*BETA)/(2.^ALPHA) ) 
B2=ALaG(I.2-BETA/(l-1.2-ALPHA) ) 
A2=AL0G( (l.-1.2*BETA)/(1.2*ALPHA)) 
B3=AL0G( 1.15*8  ETA/ ( 1-1.5*ALPHA) ) 
A3=AL0G( (1-1.15*BETA)/(1.5*ALPHAI } 
34=AL0G(  1.  1*BETA/(1-1.5=*ALPHA)  ) 
A4=AL0G( (1-1.1*BETA}/(1.5*ALPHA) ) 
AL={AL0G(2.)  )M1./C0-I./C1  ) 
AL1=AL0G(2**(C0/C1)-1.) 
F1=1-SQRT(  .1584) 

AL2  =  ALCG( .1584*Pl/(.8416*(i-Pl)  )  ) 
AL3=( ALOG( 2.)  )*( 1-(C0/C1)) 
AL4=AL0G(( 1-P1)/.1584) 
AL5=AL0G((  1-P41)/(1-P40) ) 
AL6=AL0G(P41*(1-P4J)/(P4J*(1-P41))) 
DO    5     1=1,300 

BOUND  (I  ,  1,1)  =  (  I*ALGG(Cl/CO)-«-Bl)/AL 
BGUND(I,2,1)=(A1-I*AL0G(CJ/C1J  )/AL 
BOUND  (I  ,1  ,2)=(  A2-I-^^AL3)/AL1 
BOUND! I,2,2)=(B2-I*AL3) /A LI 
BOUND (I ,1 ,3)=( A3-I*AL4)/AL2 
BOUND < I,2,3)=(B3-I*AL4)/AL2 
B0UND(I,1,4)=(A4-I*AL5)/AL6 
BQUND(I,2,4i=(B''-I«AL5)/AL6 

5  CONTINUE 

.300       READ(5 ,6  ,EN0=133a)    FMED, SHAPE 

C  FMED MEDIAN    VALUE    TO    BE    GENERATED 

C  SHAPE SHAPE    PARAMETER    IN    WEIBULL    DISTRIBUTION 

6  F0RMAT(2F6.3) 
^tRITE(6,102)FMED, SHAPE 
KCUNT=1. 

CO  7  1=1,4 
00  7  J=l ,4 

7  DATA{I,J)=0. 

C        Tl(2,3,4) TEST  STATISTIC  FOR  TEST  CASE  A(B,C,D) 

C        DCZN1(2.3,4)  —  TAKES  VALUE  1.  IF  TEST  TERM  INATED , OTHE 
C  RWISE  3. 

10         T1=0. 

T2  =  0. 

T3  =  0. 

T4=0. 

N=0. 

DCZNi=0 
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DCZN2=0 

DCZN3=0. 

DCZN4=0 
20    CALL    GGUBdSEED,  1,U) 

X  =  FNiED*(ALOG(U)/ALOG(  .5  ))=**(  1  ./SHAPE  ) 

N  =  N+1 

IF(DCZN1.5Q.1.)G0    TO    40 

T1=T1+X 

IF(T1.GT.B0LND(N, 1,1) .AN0.T1.LT.BCUND(N,2,1))    GO    TO    40 

TEST(K3UNT, 1,1)=N 

DATAd,  1)=DATA(  l,l)-»-N 

IF(T1.LE.B0UND{N, 1,1) )G0    TO    30 

TEST(K0UNT,2,1)=-1. 

GO    TO    31 

30  TEST(KOUNT, 2,1)=1. 

31  DCZN1=1. 

40  IF(DCZN2.EQ.1.)G0  TO  60 
IF(X.LE.C0)T2=T2+1. 

IFiT2.GT.B0UMD(N, 1,2)  .AN0.T2.LT.BCUND(N,2,2))G0    TO    60 
TEST(KOUNT,  1,2)=N 
C4TA(2,1 )=DATA(2, 1 )+N 
IF(T2.GE.B0UND(N,2,2) )G0   TO    50 
TEST(KOUNT, 2,2)=-l. 
GG    TO    5  1 

50  TEST(K0UNT,2,2)=1. 

51  CCZN2=1. 

60  IF(DCZN3.EQ.1.)G0  TO  80 
IF(X.LE.R)T3=T3-i-l. 

IF{T3.GT.B0UND(N, 1,3) . AND.T3.lt. BOUNDCN, 2, 3))G0  TO  80 
TEST(K0UNT,1,3)=N 
DATA(3, l)=DATA(3,l)+N 
IF(T3.GE.BaUND(N,2,3) )G0  TO  7J 
TEST(K0UNT,2,3)=-1. 
GC  TO  71 

70  TEST(K0UNT,2,3)=1. 

71  DCZN3=1. 

80  IF(DCZN4.EQ  .1)  GO  TO  90 
IF(X.LE.R2)  T4=T4+1. 

IF(T4.GT.B0UN0(N, 1,4) .AND.T4.lt. BCUNOCN, 2,4) )  GO  TO  20 
TEST(KOUNT, 1,4)=N 
DATA(4, 1J=DATA(4, 1)+N 
IF(T4. GE. BOUNDCN, 2,4) )  GO  TO  78 
TEST(KGUNT,2,4)=-1. 
GO  TO  79 

78  TEST(K0UNT,2,4)-1. 

79  DCZN4=1. 

90  DDD=DCZN1*DCZN2*DCZN3 
IF(DDD.NE.l  .)G0  TO  20 
KCUNT=K0UNT+1 

IF(KOUNT.LE.NCOUNT)GO    TO    10 
DC    100    1=1,4 

100  DATAd,  1)  =  DATA(  I  ,1)/NC0UNT 
CO    110     I=1,NC0UNT 

DC  110  11=1,4 

DATA(  II,2)=(TEST(  I  ,  1  , 1 1  )-DATA  (  U  ,  1 ) )  **2;. /FLC  AT(  NCCUNT- 
=!«l)+DATAdI,2) 

IF(TESTd,2,n)  .EC.l.  )  DATA  ( II  ,3)=DATA(  11,3  )  +  l. 
110  CONTINUE 

DC  120  J=l,4 
120  DATA( J,4)=NC0UNT-DATA(J,3) 

WRITE(6,130)  {(DATA(  I , J ) , J  =  1 ,4 )  ,  I =1 ,3) 
130  FGRMAT(/,4X,»  MEAN»  ,  FIO  .5 ,  •   VARSF10.5,*   NO  ACCEPT  • 
'*,F5.0,»   NO  REJECT  ',F5.0) 

101  F0RMAT(1JF1J.5) 

102  F0RMAT(5X,»  MEDIAN  IS«,F7.3,'     SHAPE  PARAMETER  IS», 
*F7.3) 

60  TO  303 
1000   STOP 
END 
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